Focusing on the issue that the video watermarking information is vulnerable to geometric attacks and the balance between robustness and adaptability of the watermarking algorithm, a dual watermarking scheme based on human visual characteristics and Scale Invariant Feature Transform (SIFT) was proposed. Firstly, the human visual threshold in the video sequence was taken as the maximum embedding strength of the watermark; secondly, the video frame was processed by Discrete Wavelet Transform (DWT). An adaptive watermarking algorithm based on video motion information was proposed for medium-high frequency subband coefficients; based on statistical properties of wavelet coefficients, an anti-geometric attack video watermarking scheme was proposed for low-frequency ones. Finally, SIFT was acted as the trigger to judge whether the video frame was subjected to geometric attacks. The video frames were corrected by using the SIFT scale and orientation invariance when it was under geometric attack, and the watermark signal of the video frame was extracted after correction. For video frame under non-geometric attack, the medium-high frequency extraction scheme was used directly. In comparison with the real-time robust video watermarking algorithm, called VW-HDWT (Video Watermarking based on Histogram in DWT domain) algorithm, the Peak Signal-to-Noise Ratio (PSNR) value was improved by 7.5%. Compared with the watermarking algorithm based on feature area, the capacity of watermark embedding could be increased by about 10 times. The experimental results show that the proposed scheme is robust to common geometric attacks in the condition of fine watermarking transparency.